The notion of “responsibility gap” with artificial intelligence (AI) was originally introduced in the philosophical debate to indicate the concern that “learning automata” may make more difficult or impossible to attribute moral culpability to persons for untoward events. Building on literature in moral and legal philosophy, and ethics of technology, the paper proposes a broader and more comprehensive analysis of the responsibility gap. The responsibility gap, it is argued, is not one problem but a set of at least four interconnected (...) problems – gaps in culpability, moral and public accountability, active responsibility—caused by different sources, some technical, other organisational, legal, ethical, and societal. Responsibility gaps may also happen with non-learning systems. The paper clarifies which aspect of AI may cause which gap in which form of responsibility, and why each of these gaps matter. It proposes a critical review of partial and non-satisfactory attempts to address the responsibility gap: those which present it as a new and intractable problem (“fatalism”), those which dismiss it as a false problem (“deflationism”), and those which reduce it to only one of its dimensions or sources and/or present it as a problem that can be solved by simply introducing new technical and/or legal tools (“solutionism”). The paper also outlines a more comprehensive approach to address the responsibility gaps with AI in their entirety, based on the idea of designing socio-technical systems for “meaningful human control", that is systems aligned with the relevant human reasons and capacities. (shrink)

In this paper, in line with the general framework of value-sensitive design, we aim to operationalize the general concept of “Meaningful Human Control” in order to pave the way for its translation into more specific design requirements. In particular, we focus on the operationalization of the first of the two conditions investigated: the so-called ‘tracking’ condition. Our investigation is led in relation to one specific subcase of automated system: dual-mode driving systems. First, we connect and compare meaningful human control with (...) a concept of control very popular in engineering and traffic psychology, and we explain to what extent tracking resembles and differs from it. This will help clarifying the extent to which the idea of meaningful human control is connected to, but also goes beyond, current notions of control in engineering and psychology. Second, we take the systematic analysis of practical reasoning as traditionally presented in the philosophy of human action and we adapt it to offer a general framework where different types of reasons and agents are identified according to their relation to an automated system’s behaviour. This framework is meant to help explaining what reasons and what agents play a role in controlling a given system, thereby enabling policy makers to produce usable guidelines and engineers to design systems that properly respond to selected human reasons. In the final part, we discuss a practical example of how our framework could be employed in designing automated driving systems. (shrink)

The paper has two goals. The first is presenting the main results of the recent report Ethics of Connected and Automated Vehicles: recommendations on road safety, privacy, fairness, explainability and responsibility written by the Horizon 2020 European Commission Expert Group to advise on specific ethical issues raised by driverless mobility, of which the author of this paper has been member and rapporteur. The second is presenting some broader ethical and philosophical implications of these recommendations, and using these to contribute to (...) the establishment of Ethics of Transportation as an independent branch of applied ethics. The recent debate on the ethics of Connected and Automated Vehicles presents a paradox and an opportunity. The paradox is the presence of a flourishing debate on the ethics of one very specific transportation technology without ethics of transportation being in itself a well-established academic discipline. The opportunity is that now that a spotlight has been switched on the ethical dimensions of CAVs it may be easier to establish a broader debate on ethics of transportation. While the 20 recommendations of the EU report are grouped in three macro-areas: road safety, data ethics, and responsibility, in this paper they will be grouped according to eight philosophical themes: Responsible Innovation, road justice, road safety, freedom, human control, privacy, data fairness, responsibility. These are proposed as the first topics for a new ethics of transportation. (shrink)

How does the use of military drones affect the legal, political, and moral responsibility of different actors involved in their deployment and design? This volume offers a fresh contribution to the ethics of drone warfare by providing, for the first time, a systematic interdisciplinary discussion of different responsibility issues raised by military drones. The book discusses four main sets of questions: First, from a legal point of view, we analyse the ways in which the use of drones makes the attribution (...) of criminal responsibility to individuals for war crimes more complicated and what adjustments may be required in international criminal law and in military practices to avoid ’responsibility gaps’ in warfare. From a moral and political perspective, the volume looks at the conditions under which the use of military drones by states is impermissible, permissible, or even obligatory and what the responsibilities of a state in the use of drones towards both its citizens and potential targets are. From a socio-technical perspective, what kind of new human machine interaction might drones bring and which new kinds of shared agency and responsibility? Finally, we ask how the use of drones changes our conception of agency and responsibility. The book will be of interest to scholars and students in ethics and to those in law, politics and the military involved in the design, deployment and evaluation of military drones. (shrink)

We argue that lack of direct and conscious control is not, in principle, a reason to be afraid of machines in general and robots in particular: in order to articulate the ethical and political risks of increasing automation one must, therefore, tackle the difficult task of precisely delineating the theoretical and practical limits of sustainable delegation to robots.

How should autonomous vehicles be programmed to behave in the event of an unavoidable accident in which the only choice open is one between causing different damages or losses to different objects or persons? This paper addresses this ethical question starting from the normative principles elaborated in the law to regulate difficult choices in other emergency scenarios. In particular, the paper offers a rational reconstruction of some major principles and norms embedded in the Anglo-American jurisprudence and case law on the (...) “doctrine of necessity”; and assesses which, if any, of these principles and norms can be utilized to find reasonable guidelines for solving the ethical issue of the regulation of the programming of autonomous vehicles in emergency situations. The paper covers the following topics: the distinction between “justification” and “excuse”, the legal prohibition of intentional killing outside self-defence, the incommensurability of goods, and the legal constrains to the use of lethal force set by normative positions: obligations, responsibility, rights, and authority. For each of these principles and constrains the possible application to the programming of autonomous vehicles is discussed. Based on the analysis, some practical suggestions are offered. (shrink)

The urban traffic environment is characterized by the presence of a highly differentiated pool of users, including vulnerable ones. This makes vehicle automation particularly difficult to implement, as a safe coordination among those users is hard to achieve in such an open scenario. Different strategies have been proposed to address these coordination issues, but all of them have been found to be costly for they negatively affect a range of human values (e.g. safety, democracy, accountability…). In this paper, we claim (...) that the negative value impacts entailed by each of these strategies can be interpreted as lack of what we call Meaningful Human Control over different parts of a sociotechnical system. We argue that Meaningful Human Control theory provides the conceptual tools to reduce those unwanted consequences, and show how “designing for meaningful human control” constitutes a valid strategy to address coordination issues. Furthermore, we showcase a possible application of this framework in a highly dynamic urban scenario, aiming to safeguard important values such as safety, democracy, individual autonomy, and accountability. Our meaningful human control framework offers a perspective on coordination issues that allows to keep human actors in control while minimizing the active, operational role of the drivers. This approach makes ultimately possible to promote a safe and responsible transition to full automation. (shrink)

When should we use care robots? In this paper we endorse the shift from a simple normative approach to care robots ethics to a complex one: we think that one main task of a care robot ethics is that of analysing the different ways in which different care robots may affect the different values at stake in different care practices. We start filling a gap in the literature by showing how the philosophical analysis of the nature of healthcare activities can (...) contribute to robot ethics. We rely on the nature-of-activities approach recently proposed in the debate on human enhancement, and we apply it to the ethics of care robots. The nature-of-activities approach will help us to understand why certain practice-oriented activities in healthcare should arguably be left to humans, but certain goal-directed activities in healthcare can be fulfilled with the assistance of a robot. In relation to the latter, we aim to show that even though all healthcare activities can be considered as practice-oriented, when we understand the activity in terms of different legitimate ‘fine-grained’ descriptions, the same activities or at least certain components of them can be seen as clearly goal-directed. Insofar as it allows us to ethically assess specific functionalities of specific robots to be deployed in well-defined circumstances, we hold the nature-of-activities approach to be particularly helpful also from a design perspective, i.e. to realize the Value Sensitive Design approach. (shrink)

Accountability and responsibility are key concepts in the academic and societal debate on Autonomous Weapon Systems, but these notions are often used as high-level overarching constructs and are not operationalised to be useful in practice. “Meaningful Human Control” is often mentioned as a requirement for the deployment of Autonomous Weapon Systems, but a common definition of what this notion means in practice, and a clear understanding of its relation with responsibility and accountability is also lacking. In this paper, we present (...) a definition of these concepts and describe the relations between accountability, responsibility, control and oversight in order to show how these notions are distinct but also connected. We focus on accountability as a particular form of responsibility—the obligation to explain one’s action to a forum—and we present three ways in which the introduction of Autonomous Weapon Systems may create “accountability gaps”. We propose a Framework for Comprehensive Human Oversight based on an engineering, socio-technical and governance perspective on control. Our main claim is that combining the control mechanisms at technical, socio-technical and governance levels will lead to comprehensive human oversight over Autonomous Weapon Systems which may ensure solid controllability and accountability for the behaviour of Autonomous Weapon Systems. Finally, we give an overview of the military control instruments that are currently used in the Netherlands and show the applicability of the comprehensive human oversight Framework to Autonomous Weapon Systems. Our analysis reveals two main gaps in the current control mechanisms as applied to Autonomous Weapon Systems. We have identified three first options as future work for the design of a control mechanism, one in the technological layer, one in the socio-technical layer and one the governance layer, in order to achieve comprehensive human oversight and ensure accountability over Autonomous Weapon Systems. (shrink)

David Shoemaker has claimed that a binary approach to moral responsibility leaves out something important, namely instances of marginal agency, cases where agents seem to be eligible for some responsibility responses but not others. In this paper we endorse and extend Shoemaker’s approach by presenting and discussing one more case of marginal agency not yet covered by Shoemaker or in the other literature on moral responsibility. Our case is that of Kenneth Parks, a Canadian man who drove a long way (...) to his mother-in-law’s and killed her in a state of somnambulism. We support our claim about Parks’ marginal responsibility in three steps: we first deny that Parks acts involuntarily as traditionally claimed in the legal literature; we then propose to extend Shoemaker’s analysis of marginal responsibility based on quality of will so as to include two other dimensions: the moral status of the agent and the actual causal effects of their actions; finally, we distinguish Parks’ marginal responsibility from four other existing concepts: “tracing”, diminished responsibility, causal responsibility, and moral disapproval without responsibility. (shrink)

This paper proposes that autonomous vehicles should be designed to reduce light pollution. In support of this specific proposal, a moral assessment of autonomous vehicles more comprehensive than the dilemmatic life-and-death questions of trolley problem-style situations is presented. The paper therefore consists of two interrelated arguments. The first is that autonomous vehicles are currently still a technology in development, and not one that has acquired its definitive shape, meaning the design of both the vehicles and the surrounding infrastructure is open-ended. (...) Design for values is utilized to articulate a path forward, by which engineering ethics should strive to incorporate values into a technology during its development phase. Second, it is argued that nighttime lighting—a critical supporting infrastructure—should be a prima facie consideration for autonomous vehicles during their development phase. It is shown that a reduction in light pollution, and more boldly a better balance of lighting and darkness, can be achieved via the design of future autonomous vehicles. Two case studies are examined through which autonomous vehicles may be designed for “driving in the dark.” Nighttime lighting issues are thus inserted into a broader ethics of autonomous vehicles, while simultaneously introducing questions of autonomous vehicles into debates about light pollution. (shrink)

The paper presents a framework to realise “meaningful human control” over Automated Driving Systems. The framework is based on an original synthesis of the results of the multidisciplinary research project “Meaningful Human Control over Automated Driving Systems” lead by a team of engineers, philosophers, and psychologists at Delft University of the Technology from 2017 to 2021. Meaningful human control aims at protecting safety and reducing responsibility gaps. The framework is based on the core assumption that human persons and institutions, not (...) hardware and software and their algorithms, should remain ultimately—though not necessarily directly—in control of, and thus morally responsible for, the potentially dangerous operation of driving in mixed traffic. We propose an Automated Driving System to be under meaningful human control if it behaves according to the relevant reasons of the relevant human actors (tracking), and that any potentially dangerous event can be related to a human actor (tracing). We operationalise the requirements for meaningful human control through multidisciplinary work in philosophy, behavioural psychology and traffic engineering. The tracking condition is operationalised via a proximal scale of reasons and the tracing condition via an evaluation cascade table. We review the implications and requirements for the behaviour and skills of human actors, in particular related to supervisory control and driver education. We show how the evaluation cascade table can be applied in concrete engineering use cases in combination with the definition of core components to expose deficiencies in traceability, thereby avoiding so-called responsibility gaps. Future research directions are proposed to expand the philosophical framework and use cases, supervisory control and driver education, real-world pilots and institutional embedding. (shrink)

When should humans enhance themselves? We try to answer this question by engaging in a conceptual analysis of the nature of different activities. We think that cognitive enhancement is morally impermissible in some practice-oriented activities, such as some educational activities, when it is the case both that cognitive enhancement would negatively affect the point of those activities and that we have good reasons to value that point. We then argue that cognitive enhancement should be allowed in two groups of cases, (...) namely in practice-oriented activities, such as recreational activities on which little moral value or social import hangs, and in some prominently goal-directed activities, such as high-responsibility professions, the goal of which has significant moral or social value. Finally, we argue that the use of efficacious and relatively safe cognitive enhancers may even be obligatory in those high-responsibility professions under certain special circumstances. (shrink)

We propose a multi-step evaluation schema designed to help procurement agencies and others to examine the ethical dimensions of autonomous systems to be applied in the security sector, including autonomous weapons systems.

The scope and mission of the history of science have been constant objects of reflection and debate within the profession. Recently, Lorraine Daston has called for a shift of focus: from the history of science to the history of knowledge. Such a move is an attempt at broadening the field and ridding it of the contradictions deriving from its modernist myth of origin and principle of demarcation. Taking the move from a pluralistic concept of medicine, the present paper explores the (...) actual and possible contributions that a history of knowledge can offer to the history of medicine in particular. As we will argue, the history of medicine has always been a history of knowledge, but for good reasons has always stuck to the concept of medicine as its object and problem throughout the ages, including the modern, scientific one. We argue that, in the history of medicine, the demarcation between scientific and non‐scientific represents an accident, but is not foundational as in the case of natural science. Furthermore, the history of medicine programmatically played a role in at least two academic domains (history proper and medical education), adjusting historical narratives of medical knowledge to its audience. Accordingly, we underscore that the history of both science and medicine, as traditionally defined, already provides room for almost the whole spectrum of approaches to history. Moreover, their different myths of origin can, and indeed must, be included in the reflexivity of the historical gaze. We argue that the position towards a history of science, medicine, or knowledge is not a question of narrative or theory, rather, it is a question of relevance and awareness of extant contexts. (shrink)

In prevention and health promotion interventions, screening methods and risk profile assessments are often used as tools for establishing the interventions’ effectiveness, for the selection and determination of the health status of participants. The role these instruments fulfil in the creation of effectiveness and the effects these instruments have themselves remain unexplored. In this paper, we have analysed the role screening methods and risk profile assessments fulfil as part of prevention and health promotion programmes in the selection, enrolment and participation (...) of participants. Our analysis showed, that screening methods and health risk assessments create effects as they objectify health risks and/or the health status of individuals, i.e., they select the individuals ‘at risk’ and indicate the lifestyle modifications these people are required to make in order to improve their health. Yet, these instruments also reduce the group of participants thereby decreasing the possible effect of interventions, as they provide the legitimisation for people to make choices to whether they enrol or not and what lifestyle changes they incorporate into their lives. In other words, they present a space of interaction, in which agency is distributed across the practice nurses, the participants and the instruments. Decisions were not just made upon the projection of the outcomes of these instruments; decisions that were made by both the patients and practice nurses were the resultant of their opinions on these outcomes that were formed in interaction with the instruments. (shrink)

En los más disímiles contextos universitarios, se generan hoy programas para mejorar los desempeños de los docentes en el proceso formativo; pero, infortunadamente estos no siempre resultan en un mejoramiento de la práctica cotidiana de las universidades, sobre todo en la calidad de la formación de los profesionales. De este hecho, el propósito del presente artículo está dado en realizar una valoración de las principales influencias epistemológicas en lo relativo a la profesionalización del docente universitario y develar aquellos desempeños idóneos (...) esenciales que deben poseer en este nivel de educación como expresión de las competencias que deben desarrollar. Today, in most diverse university contexts, programs are developed to improve the performance of professors in the educational process; but unfortunately, they do not always result in improving the daily practice of universities, especially in the quality of professionals training. Of this fact, the purpose of the present article is to carry out a valuation of the main epistemological influences related to the professionalization of universities` professors; and to determine the main essential suitable performances these professionals should have as an expression of the competences they must develop. (shrink)

Current UK legislation is impacting upon the feasibility and cost-effectiveness of medical record-based research aimed at benefiting the NHS and the public heath. Whereas previous commentators have focused on the Data Protection Act 1998, the Health and Social Care Act 2001 is the key legislation for public health researchers wishing to access medical records without written consent. The Act requires researchers to apply to the Patient Information Advisory Group for permission to access medical records without written permission. We present a (...) case study of the work required to obtain the necessary permissions from PIAG in order to conduct a large scale public health research project. In our experience it took eight months to receive permission to access basic identifying information on individuals registered at general practices, and a decision on whether we could access clinical information in medical records without consent took 18 months. Such delays pose near insurmountable difficulties to grant funded research, and in our case £560 000 of public and charitable money was spent on research staff while a large part of their work was prohibited until the third year of a three year grant. We conclude by arguing that many of the current problems could be avoided by returning PIAG’s responsibilities to research ethics committees, and by allowing “opt-out” consent for many public health research projects. (shrink)

The majority of Dutch physicians feel pressure when dealing with a request for euthanasia or physician-assisted suicide. This study aimed to explore the content of this pressure as experienced by general practitioners. We conducted semistructured in-depth interviews with 15 Dutch GPs, focusing on actual cases. The interviews were transcribed and analysed with use of the framework method. Six categories of pressure GPs experienced in dealing with EAS requests were revealed: emotional blackmail, control and direction by others, doubts about fulfilling the (...) criteria, counterpressure by patient’s relatives, time pressure around referred patients and organisational pressure. We conclude that the pressure can be attributable to the patient–physician relationship and/or the relationship between the physician and the patient’s relative, the inherent complexity of the decision itself and the circumstances under which the decision has to be made. To prevent physicians to cross their personal boundaries in dealing with EAS request all these different sources of pressure will have to be taken into account. (shrink)